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ABSTRACT 



An information processing apparatus for controlling 
window positions comprising a pen for inputting coor- 
dinate information, a tablet for generating coordinate 
data based on coordinate information input by the pen 
onto the tablet, a display placed under the tablet in such 
a manner that an image on the display is visible through 
the tablet means, and first display control means for 
opening in a predetermined position a new window 
corresponding to the icon selected by a checking (pen 
down, pen up at a single icon location) operation of the 
pen. The apparatus also includes a second display con- 
trol means for opening a new. window in a desired posi- 
tion outside the icon area selected by a dragging opera- 
tion of the pen, the dragging operation being executed 
by three actions. First, the pen is put down onto the 
icon in the icon area of the display means, the pen is 
dragged together with the icon to a desired position 
outside the icon area, and the pen is then lifted off the 
tablet. 

3 Claims, 9 Drawing Sheets 
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With such information processing systems, a display 

INFORMATION PROCESSING APPARATUS FOR screen H shown in FIG. 1 is switched according to the 

CONTROLLING WINDOW POSITIONS user s selecting operation. Referring to FIG. 1. icons 

1A, IB, etc. are displayed in the upper and right hand 

BACKGROUND OF THE INVENTION 5 margins of the screen H. In operation, the user puts a 

1. Field of the Invention pointing pen, not shown, down to one of the icons (1A. 
The present invention relates to an information pro- *B. «c.) on the screen and drags the pen to a suitable 

cessing apparatus for controlling window positions, the position thereon. This causes a window W correspond- 

apparatus allowing the window corresponding to a '"f. 1 ? ^ e se 'ect<jd «con to appear in the position from 

selected icon on a display screen to be opened in the 10 ^ h,ch the pen " ,,fted U P- Indications in the window let 

position in which the icon is checked with a pointing th f use f proceed to con,ro1 such P ersonal ""formation as 

device, or in the position to which the icon is dragged scnedues. 

with the pointing device and from which the pointing Glven ,h,sk 1 l nd of '"formanon processing system the 

device is lifted up re user may wish to change the display position of the 

2. Description of the Prior Art 15 W " des, ' red ' Jj* ma y *° wish 10 s,ore 
Computers used to be given instructions only in com- thed>splayed wmdow W. 

piiter language. Because those who were not versed in ,. If the user ™ shes . to s,ore ^ e displayed window W. 

the arcane computer-oriented language had difficulty in ,hc } te P»"«»8 pen down to a predetermined 

operating computers, recent yeari hale seen a growing „ T^ JL a^t^^^ ^ **• Pe " '° ■" 

number of computers that run under special tindow 20 d ' p ' ay a f rea ARST (Fla *} When ,he P 0,n ! ,n f P» " 

controlling apparatuses for user-friendlv window con- 1 £^ p ,t rom ^ TOI ™ s P° ndln S lcon ln « he d'splay area 

trol. These apparatuses permit almost anyone easy con- AR f S ^ ,he ^. ndow W " s,or ^ . . A 

trol of the computer through the use of displayed icons ,/ he pom, r ,nS Pe " !? d ? gE ^ a " 8rea ARDP 

that represent necessary computer functions. „ HS^,*"" T """^ct d ' s P la ^ ree " H a "d 

In operation, the window controlling apparatus al- 25 ^ AR ?' * e w «^* fc w » n « 

, . . , r.t_ - « • f r , , stored but is moved to the position from which the oen 

lows the user to pick one of the icons displayed on the is ^ d v H 

screen. When a given icon is selected, the window cor- A * a^F^u a *u c n- 

*u . .u «/■ j As desenbed. the operations for controlling window 

responding thereto appears on the screen. Wmdow itions on the ^ of , he ab(Jve rf * 00 

controlling apparatuses come in two types: one that J0 complicated . constraine d and confusing. 

permits the window corresponding to a selected icon to e 

appear over the entire screen, and the other tvpe having SUMMARY OF THE INVENTION 

each icon-associated window displayed partially on the It is therefore an object of tfc . 

screen. The present invention proposes an information ide an information J processing apparatus for con- 

processing apparatus for controlling window positions 35 tro]li window itiom the allowi lhg 

which belongs to the latter type. user t0 , one of lhe two F icon . seIectj * eth _ 

Traditionally, there are wo ways to select an icon by ods? .. chcck .. and „ d « w Q } ^ d * 

use of a pointing device, illustratively a pen. One way is as desired on the screc * 

to "check" one of the displayed icons using the pointing ln carrying out the invemion and according to one 

pen The checking action involves placing the pointing « aspect thereof, there is provided an information pro- 

pen down to the icon position and then lifting up the cessing apparatus for controlling window positions 

pen therefrom. That is. the desired icon is apparently comprising: (a) pen means for inputting coordinate in- 

■pressed for a short period of time. The other way to formation; (b) tablet means for generating coordinate 

select the icon is to 'drag it. That is, the pointing pen data based on the coordinale information input by the 

is placed on the desired icon position and is moved as 45 pen means onto the tablet means: (c) display means 

held down up to a new position where a new window is p i ace d under the tablet means in such a manner that an 

to be opened. j mage displayed on the display means is visible through 

Conventional information processing apparatuses for the tablet means: (d) first display control means for 
controlling window positions adopt exclusively one of opening in a predetermined position a new window 

the two icon-selecting methods, "check" or "drag." It is 50 corresponding to the icon selected by a checking opera- 

theoretically possible to design an apparatus that would tion of the pen means, the checking operation being 

be switched to one of the two methods as desired. How- executed by two actions, the first action involving put- 

Q evcr » one disadvantage of that type of apparatus is that ting the pen means down onto the icon in an icon area 

J the switching must be accomplished beforetfi^^ displayed on the display means, the second action in- 

ju^sjcjivatedL^For the majority of the prior an appara- 55 volving lifting up the pen means from the icon within 

, tuses that rely on one of the two methods, operations the icon area, the executing of the checking operation 

carried out according to the other unadopted method being detected based on the coordinate data generated 

are regarded as errors and all inputs intended thereby by the tablet means: and (e) second display control 

are thus rejected. means for opening in a desired position outside the icon 

In this connection, there are also proposed informa- 60 area a new window corresponding to the icon selected 

tion processing systems that control entry of and by a dragging operation of the pen means, the dragging 

changes to various kinds of personal information, such operation being executed by three actions, the first ac- 

as electronic address books and electronic telephone tion involving putting the pen means down onto the 

directory and schedule table devices known as organiz- icon in the icon area displayed on the display means, the 

* ers. Such sy^ms_are disclosed in U.S. patent applica- 65 second action involving dragging the pen means to- 

C)W<iK* ^tion-Serr>(^^21JB9^ having a common assignee and in gether with the icon up to the desired position outside 

the present assigfleTs Japanese Patent Application No. the icon area, the third action involving lifting up the 

2 (1990V84318. pen means from the icon outside the icon area, the exe- 
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curing of the dragging operation being detected based 
on the coordinate data generated by the tablet means. 

In operation, the inventive information processing 
apparatus for controlling window positions opens a new 
window in one of two ways. When an icon is checked 
with the pointing pen attached to the apparatus, the 
apparatus opens a new window in a predetermined 
position (e.g., the position where the old window was 
previously being opened). When an icon is dragged 
with the pointing pen, the apparatus opens a new win- 
dow in the position to which the icon is dragged and 
from which the pointing pen is lifted up. 

Further objects, features and advantages of this in- 
vention will become more apparent upon a reading of 
the following description and appended drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a view of a typical screen of a prior art 
information processing apparatus for controlling win- 
dow positions; 

FIG. 2 is a block diagram showing the construction 
of a computer-operated device embodying the inven- 
tion; 

FIG. 3 is a flowchart showing how the embodiment 
of FIG. 2 works; 

FIG. 4 is a view of a typical screen displayed when 
power is applied to the embodiment: 

FIG. 5 is a view of a typical screen displayed when a 
37 TOOLBOX" window is opened on the embodiment; 

FIG. 6 is a view of a typical screen displayed when 
another window is opened on the embodiment; 

FIG. 7 is a flowchart describing the steps carried out 
between pen-down operation and pen -up operation on 
the embodiment; 

FIG. 8 is a view of a screen state that contains a 
contour indicating the position in which to open a win- 
dow following a dragging operation on the embodi- 
ment; and 

FIG. 9 is a view of another screen state that includes 
a contour indicating the position in which to open a 
window following a dragging operation on the embodi- 
ment. 

DESCRIPTION OF THE PREFERRED 
EMBODIMENT 

FIG. 2 is a block diagram showing the construction 
of an electronic "organizer" notebook device to which 
the invention is illustratively applied. In FIG. 2, an 
input unit 1 incorporates various switches including a 
power switch. The signals corresponding to these 
switches are supplied to a CPU 4 via an interface 2. A 
DC voltage, obtained by rectifying an AC power 
source, is fed to a power supply circuit 3. The power 
supply circuit 3 contains a battery 3a inside. When the 
AC power source supplies the DC voltage through 
rectification, that voltage is used to power the compo- 
nents of the device; when the AC power source does 
not supply the DC voltage, the battery Za takes over 
and powers the device components. 

The interface 2 has a tablet 8, a display unit 9 and a 
speaker 10 connected thereto. The interface 2 is also 
connected via a bus line with the CPU 4, a ROM 5, a 
RAM 6 and a backup memory 7. 

The tablet 8 is made of a transparent touch electrode 
attached to the display surface of the display unit 9. The 
icons such as buttons displayed on the display unit 9 are 
used as input buttons of the tablet 8. When a user 
touches one of these icons visible through the transpar- 
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ent touch electrode, the coordinate signal defining the 
touched part is sent to the CPU 4 for necessary process- 
ing. 

Touching a part of the tablet 8 generates the coordi- 
5 nate signal corresponding to the touched part. The 
signal may be generated by one of two methods. One 
method is a pressure sensitive method whereby the 
pointing pen when operated senses a mechanical pres- 
sure change that triggers the signal. The other method 
10 is an electrostatic capacity method whereby the point- 
ing pen when operated senses a capacitance change that 
results in signal generation. Either method may be used. 

FIG. 3 is a flowchart depicting how the embodiment 
of FIG. 2 operates when the pointing pen is placed onto 
15 the screen. When the embodiment is powered, the dis- 
play screen of FIG. 4 appears on the display unit 9. 
When an icon "TOOLBOX" is selected tn a suitable 
mode, the "TOOLBOX" window of FIG. 5 is dis- 
played. This window contains various icons. To input, 
20 say, characters, the user opens a character input win- 
dow by selecting an icon "CHARACTERS." 

The "CHARACTERS" icon is selected by first plac- 
ing the pointing pen down to that icon and then lifting 
up the pen therefrom. The pen-down action selects the 
25 icon, and the pen-up action determines the position in 
which the window corresponding to the selected icon is 
to be opened. The processing following the pen-up 
action takes place as follows. 
Step 100 of FIG. 3 performs necessary processing 
30 between pen-down action and pen-up action. Details of 
this processing will be described later with reference to 
the flowchart of FIG. 7. Suppose now that the pointing 
pen is lifted up from a particular position and that the 
coordinates of that position are detected. Then step 101 
35 is reached. In step 101, a check is made to see if the 
coordinates of the pen-up position represent an icon 
area. The icon area is a screen area in which various 
icons, such as those in FIG. 5. are displayed. In FIG. 5, 
the "CHARACTERS" icon is displayed in reverse 
40 video. The reverse video display is executed upon pen- 
down action. 

As described earlier, there are two ways to open a 
window: either to "check" the necessary icon with the 
pointing pen by putting the pen down to the icon and 

45 then lifting up the pen therefrom; or to "drag" the pen 
together with the selected icon as the pen is held down 
onto the tablet, the icon being released by lifting up the 
pen when a desired position is reached. When the icon 
is "checked," a new window is allowed to open in a 

50 predetermined position (with this embodiment, the posi- 
tion where the old window was previously being 
opened); when the icon is "dragged," a new window 
opens in the position where the pointing pen after drag- 
ging operation is lifted up. 

55 Suppose that the coordinates detected in the pen-up 
position are generated by a checking operation. In that 
case, the pen-down position is located in the same icon 
area as the pen-down position. Thus step 101 yields the 
affirmative decision, i.e., the decision that the coordi- 

60 nates of the pen-up position are within the icon area. 
The affirmative decision in step 101 is followed by step 
102. In step 102, the X and Y coordinate values of the 
position in which to open the new window are set re- 
spectively to the X and Y coordinate values in effect 

65 immediately before the old window was closed (func- 
tion of first display control means). 

In step 104, a character input window (character 
plate W) shown in FIG. 6 is opened. The display po.si- 
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tion of this window is set so as to conform to the X and 

Y coordinates established in step 102. That is, the char- 
acter plate W is again opened in the position where the 
preceding character plate W was being opened. 

Steps 102 and 104 constitute the first display control 
means for opening, when an icon is checked, the corre- 
sponding new window in the position in which the old 
window was being opened. 

When the coordinates of the pen-up position are de- 
tected following a dragging operation, the pen-up posi- 
tion is located outside the icon area. In that case, step 
101 finds that the coordinates of the pen-up position are 
not included in the icon area. The negative decision of 
step 101 is followed by step 103. In step 103, the X and 

Y coordinate values of the position in which to open the 
new window are set respectively to the X and Y coordi- 
nate values of the pen-up position (function of second 
display control means). 

Then in the same manner as with the checking opera- 
tion, step 104 opens the new window in the position 
defined by the X and Y coordinate values. The dragging 
operation opens a window in the position where the 
pointing pen is lifted up. That is. a window may be 
opened anywhere on the screen. 

Steps 103 and 104 constitute the second display con- 
trol means for opening a new window in the position to 
which an icon is dragged with the pointing pen and 
from which the pointing pen is lifted up. 

FIG. 7 is a flowchart depicting the processing in 
effect up to a pen-up operation. When the pointing pen 
is placed down to a given position on the screen, the X 
and Y coordinate values of that pen-down position are 
retained respectively as X and Y in step 110. In step 111. 
a contour defining a predetermined range (i.e., icon 
contour) is drawn in the position designated by the X 
and Y coordinate values retained. 

Step 112 checks to see if the pointing pen is lifted up. 
If the pen is found to be up. step 118 is reached. In step 
118, the contour drawn in step 111 is erased and control 
is returned to the routine of FIG. 3. This means that a 
checking operation has been executed, with the coordi- 
na?-.-N of the pen-down position detected and the pen 
lifted up immediately thereafter. 

Where a dragging operation is carried out. step 111 in 
which the contour was drawn is followed by step 112. 
Step 112 finds that the pointing pen is not lifted up. That 
is, the pen is moved as pressed against the tablet 8. Then 
step 112 is followed by step 113. In step 113. the X and 

Y coordinate values of the current pen position are 
stored respectively as new coordinate values XN and 
YN. Step 114 checks to see if the coordinates of the 
pointing pen are the same as the newly stored coordi- 
nates XN and YN. If they are the same, step 112 is 
reached again in which a check is made to see if the 
pointing pen is lifted up. The values XN and YN are not 
updated while the pen movement is being halted on the 
screen. As long as the pointing pen remains stationary, 
steps 112 through 114 are repeated. 

When the pointing pen is moved (i.e., dragged) over 
the screen, step 114 finds the coordinates thereof to be 
new and thus different from XN and YN. In that case, 
step 114 is followed by step 115 in which the contour 
defined by the X and Y coordinate values and drawn in 
step 111 is erased. In step 116. the values XN and YN 
are stored as the coordinate values X and Y for display- 
ing a new contour. In step 117. the new contour is 
drawn as per the stored coordinate values X and Y. Step 
117 is followed by step 112. 
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As described, a dragging operation (i.e., pointing pen 
movement) causes the contour K drawn in step 117 to 
move over the screen ''dragged" by the pen, as shown 
in FIGS. 8 and 9. The contour drawn at this point indi- 

5 cates the position in which to open a new window. If 
the pointing pen is not moved far enough to go out of 
the icon area, the contour K is displayed in small size 
(the same in size as the "CHARACTERS'* icon), as 
illustrated in FIG. 8. If the pointing pen is moved out of 

10 the icon area, the contour K is displayed in large size 
(the same in size as the character plate W), as depicted 
in FIG. 9. 

If the pointing pen still remains put down on the 
screen surface when control is returned to step 112, step 

15 113 and subsequent steps are carried out. If there is no 
pointing pen movement, step 114 finds that the stored 
coordinate values remain the same. This returns control 
to step 112. If the pointing pen is dragged, step 114 finds 
the coordinates thereof to be new. This leads to step 115 

20 in which the contour being displayed is erased. In step 
117, a new contour is drawn in the position to which the 
pointing pen is dragged. 

While the pointing pen remains stationary, the con- 
tour K also stays put. When the pointing pen is dragged 

25 over the screen surface, the contour K is moved along 
with the pen. At a later time, the pointing pen is lifted 
up. The pen-up operation is then detected in step 112. 
which is followed by step 118. Step 118 erases the cur- 
rently displayed contour K, and control is returned to 

30 step 101 in FIG. 3. 

Step 101 in FIG. 3, when reached from step 118, is 
followed by the subsequent steps that open the window 
W as shown in FIG. 6. As described earlier, the check- 
ing operation of the pointing pen establishes the previ- 

35 ous window position as the position in which this win- 
dow is opened; the dragging operation of the pen sets 
up the pen-up position as the window opening position. 

While the pointing pen together with an icon is being 
dragged (in pen-down state), the corresponding win- 

40 dow is not displayed. Instead, the contour K of the 
window is displayed in the position in which the win- 
dow is to be opened, as illustrated in FIG. 9. This is 
because it takes some time to display the entire window 
and because it is temporally difficult to move the entire 

45 window along with the pen as the latter is being 
dragged at high speed. Alone, the window contour may 
be moved at high speed following the pointing pen 
being dragged. 

When a character is hand-written in a square 21 of the 

50 character plate W in FIG. 6, the strokes are recognized 
as a pattern, and the recognized character is displayed 
in that square. When a WRITE button 22 is touched 
with the pointing pen, the character in the square 21 is 
written into a suitable position. 

55 As described, the information processing apparatus 
for controlling window positions according to the in- 
vention opens a window in a predetermined position 
when an icon is checked with the pointing pen, or in the 
position to which the icon is dragged and from which 

60 the pointing pen is lifted up. This allows users to select 
icons by any pen-based input method. There is no need 
to switch between different pen-based input methods 
before or halfway through operation. This enhances the 
operability of the computer system in which the inven- 

65 tive apparatus is incorporated. When different users 
accustomed to different pen-based input methods oper- 
ate the computer system, prior an apparatuses would 
accept some pen operations, reject some pen operations 
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as errors or system failure, and demand repeated opera- 
tions until the appropriate pen-based input method is 
complied with. Unlike its prior art counterparts, the 
inventive apparatus accepts all kinds of pen operations 
and saves the user a significant amount of operating 5 
chores. 

While a preferred embodiment of the invention has 
been described using specific terms, such description is 
for illustrative purposes only, and it is to be understood J0 
that changes and variations may be made without de- 
parting from the spirit or scope of the following claims. 

What is claimed is: 

1. An information processing apparatus for control- 
ling window positions comprising: is 

(a) pen means for inputting coordinate information; 

(b) tablet means for generating coordinate data based 
on said coordinate information input by said pen 
means onto said tablet means; 

(c) display means placed under said tablet means in 20 
such a manner that an image displayed on said 
display means is visible through said tablet means: 

(d) first display control means for opening in a prede- 
termined position a new window corresponding to 2 j 
an icon selected by a checking operation of said 
pen means, said checking operation being executed 
by two actions, the first action involving putting 
said pen means down onto said icon in an icon area 
displayed on said display means, the second action 30 
involving lifting up said pen means from said icon 
within said icon area, the executing of said check- 
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ing operation being detected based on the coordi- 
nate data generated by said tablet means: and 
(e) second display control means for opening in a 
desired position outside said icon area a new win- 
dow corresponding to an icon selected by a drag- 
ging operation of said pen means, said dragging 
operation being executed by three actions, the first 
action involving putting said pen means down onto 
said icon in said icon area displayed on said display 
means, the second action involving dragging said 
pen means together with said icon up to said de- 
sired position outside said icon area, the third ac- 
tion involving lifting up said pen means from said 
icon outside said icon area, the executing of said 
dragging operation being detected based on the 
coordinate data generated by said tablet means. 

2. An information processing apparatus for control- 
ling window positions according to claim 1, wherein 
said checking operation involves putting down said pen 
means onto., said icon area and lifting up said pen means 
from said icon area without moving said pen means 
horizontally over said display means. 

3. An information processing apparatus for control- 
ling window positions according to claim 1, further 
comprising storage means for storing the coordinate 
data defining the position in which to open at least a 
previously opened window, wherein said checking op- 
eration opens a new window according to said coordi- 
nate data stored in said storage means, said new window 
being displayed in the position in which the previous 
window was opened. 
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